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We analyze non-linear transverse mode coupling in a Kerr 
medium placed in an optical cavity and its influence on bista- 
bility and different kinds of quantum noise reduction. Even 
for an input beam which is perfectly matched to a cavity 
mode, the non-linear coupling produces an excess noise in the 
fluctuations of the output beam. Intensity squeezing seems 
to be particularly robust with respect to mode coupling while 
quadrature squeezing is more sensitive. However it is possi- 
ble to find a mode the quadrature squeezing of which is not 
affected by the couphng. 

PACS number(s): 42.65. Sf 



I. INTRODUCTION 

During the last years different kinds of systems for the 
generation of squeezed light have been proposed and re- 
alized. The bistable device obtained by placing a non- 
linear Kerr medium inside an optical cavity is one of 
them. When the bistability turning point is approached, 
the fluctuations in one of the field quadratures of the 
incoming beam are reduced below shot noise 
Nearly perfect squeezing is expected when the non-linear 
medium is a lossless Kerr medium 1^,^,0. Squeezing 
via the optical Kerr effect was experimentally demon- 
strated at the output of a bistable cavity containing an 
atomic beam j^jjoj or a cloud of cold atoms released from 
a magneto-optical trap [0 . 

Most theoretical treatments have simplified the de- 
scription of the field-matter interaction by modeling the 
laser beam as a plane- wave [1-7]. Thanks to these works, 
the squeezing mechanism in this system is well under- 
stood and it has been shown that this kind of device has 
the potential to generate very large squeezing. There 
is now a need for more complete models, either to an- 
alyze experimental results of current experiments or to 
estimate the limitations of future set-ups. For more re- 
alistic systems it is clear that the plane wave description 
has to be modified to account for the spatial structure of 
the laser beam. When dealing with a non-linear medium 
made of atoms, a first step consists in averaging the mean 
field as well as the fluctuations over the beam profile in 
order to take into account the differences of light inten- 
sity and of coupling strength at different localizations 
inside the beam | pl] , p^ , p^ , p^ . This leads to a modifica- 
tion of the bistability curve and of the squeezing obtain- 
able with the device. Only in the limit of an ideal Kerr 



medium (characterized by a x*-^-* susceptibility) this sin- 
gle transverse mode approach leads to results identical to 
the plane wave model |l4| . 

It is also well known that the interaction of a light 
beam with a non-linear medium gives rise to transverse 
spatial effects which may have a strong influence on the 
quantum fluctuations of the beam |l5[ , [l^ . For a Kerr 
medium, the first effects of the non-linearity (before the 
appearance of spatial instabilities) are self focusing or 
self defocusing. When dealing with a medium inside an 
optical cavity, these effects produce a coupling between 
different transverse modes, which depends on the intra- 
cavity intensity and changes not only the mean field but 
also field fiuctuations. In particular the non-linear cou- 
pling produces an excess noise which is appreciable even 
if the cavity is perfectly matched to the spatial structure 
of the input beam. The existence of this coupling is of 
course well known, and most of the time cavities are de- 
signed to avoid a degeneration between a transverse mode 
and the fundamental mode of the cavity. Single mode op- 
eration is thus achieved. However, as we will show in this 
paper, transverse modes have to be taken into account 
even for an input mode which is perfectly matched to 
the fundamental mode of a nondegenerate cavity. We 
will evaluate their effect on the quantum noise reduction 
and show that they can constitute a limiting factor for 
squeezing obtainable in the fundamental mode. 

We study in particular the influence of higher order 
transverse cavity modes on optical bistabilty and on dif- 
ferent kinds of quantum noise reduction. The calcula- 
tions are based on a linear input-output formalism where 
fluctuations are linearized around the working point of 
the system We describe the spatial beam structure 
in terms of Gauss-Laguerre modes. The effect of the Kerr 
non-linearity is then a coupling between the transverse 
modes. In section II, we derive the coupling coefficients 
between the modes for a light beam propagating through 
a thin Kerr medium. To present our approach we study 
in section III the propagation through a thin medium 
in free space. The modes coupling is at the origin of 
non-linear losses for the fundamental mode. We show 
that the fluctuations associated to these losses are not 
vacuum fluctuations but correspond to phase conjugated 
noise. In section IV we consider a Kerr medium inside 
an optical cavity. We derive analytic expressions for the 
excess noise produced in the fundamental mode through 
the coupling to higher order modes. In free space, this ex- 
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cess noise can not be neglected since its strength is of the 
same order of magnitude than the strength of the para- 
metric noise modification. However, if the Kerr medium 
is placed in a cavity, the cavity provides a mode selection 
which can lead to an important reduction of the per- 
turbing effect of higher order transverses modes on the 
fundamental mode. When the cavity is non degenerate 
and the transverse mode spacing is large compared to the 
cavity width, one can perform a perturbative treatment 
in order to evaluate the influence of transverse mode cou- 
pling on the fundamental cavity mode. The fundamental 
mode may also accidentally coincide with a higher or- 
der mode corresponding to an other longitudinal mode 
family. In this case, one can calculate steady state and 
fluctuations by performing a two mode approximation 
described in the second part of section IV. The analysis 
of transverse mode coupling will finally enable us to esti- 
mate the validity limit of a single mode approximation. 
The discussion of the results as well as some conclusive 
remarks will be presented in section V. Details of the 
calculations are exposed in the appendix. 



II. NONLINEAR COUPLING OF 
GAUSS-LAGUERRE MODES IN A KERR 
MEDIUM 

In this section, we study the propagation of a light 
beam of arbitrary transverse shape through a thin Kerr 
medium. The analysis will supply us with the coupling 
coefficients between different transverse modes due to 
non-linear coupling. We consider a light beam of fre- 
quency wl which is described by the complex amplitude 
E (r) of the electric field where r stands for the three- 
dimensional position (r, 9, x) in cylindrical coordinates: 



E{v) 



(1) 



In the paraxial approximation, the propagation of the 
field amplitude along the x direction is given by 
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Pnl (r) is the non-linear polarization of the medium, 
stands for the transverse Laplacian and = wl/c is the 
light wavevector. The electric field may be expanded in 
Gauss-Laguerre modes Up"* (r) which are solutions of the 
propagation equation in free space in cylindrical coordi- 
nates: 
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Lp'^ is the generalized Laguerre polynomial, ipp' (r) is 
the phase of the mode, A is the laser wavelength, w (x) 
the beam size, wq the beam waist and Ir the Rayleigh 
divergence length: 
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The fundamental Gaussian mode (TEMqo) corresponds 
to the indices p = and / = 0. With the help of the nor- 
malization relations for Gauss-Laguerre modes [T^ one 
can derive the propagation equation for the mode ampli- 
tudes A'j!^ (x) in presence of a dielectric medium: 
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We will now assume the non-linearity to be represented 
by a lossless Kerr medium. The polarization P (r) in this 
medium can be expressed through the non-linear suscep- 
tibility: 
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From equation (||) we deduce the propagation equation 
for the field amplitudes 
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where we have introduced the coupling coefficients 
Ap,^"°^ (x) between different modes: 
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A('™r^ = 2 / dv (v) (v) (v) (v) 
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exp [—2v] . 



The dimensionless coefficients Xp^^""^ can be evaluated 
with the use of generating functions. Details of the cal- 
culation are exposed in appendix (A) . In expression (|l^) , 
one notices the presence of a selection rule I + m — n + o 
which is due to the revolution symmetry of the problem. 
When a circularly symmetric beam {I — 0) is sent into 
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the medium, one can deduce from propagation equation 
( |lo| ) that it wiU only couple to higher order modes having 
the same (circular) symmetry. In this case, we will drop 
the index I 
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In this discussion we have neglected the effect of trans- 
verse instabilities, which arise in some region of param- 
eter space especially for high intensities, which we 
do not want to treat here. 



that as soon as the non-linear phase shift becomes impor- 
tant, the associated losses can not be neglected and a per- 
turbative treatment of the coupling between the modes 
does not hold anymore. 

Before calculating the propagation of fluctuations we 
will briefly introduce our notation and the input-output 
formalism. A detailed presentation of this method can 
be found in We will denote ap the fluctuation am- 
plitude of mode p {a* for its conjugate). To simplify no- 
tations it is convenient to use a vectorial notation where 
fluctuations of the light beam are completely described 
by a vector ~ap containing the two complex amplitudes: 



III. FIELD PROPAGATION IN FREE SPACE 
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We will now apply the treatment of non- linear coupling 
developed in the previous section to the propagation of 
a fundamental Gaussian mode through a Kerr medium. 
In order to simplify calculations we will consider a par- 
ticular situation which is however often encountered in 
experiments. We assume the length L of the medium to 
be much shorter than the Rayleigh divergence length. If 
the medium is placed in the beam waist, equation ( |l0| ) 
for the propagation of the mode amplitudes simplifies to 
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Let the amplitude of the incoming beam be Ain- We 
will now study perturbatively the propagation of the 
fundamental mode inside the medium in the limit of a 
small non-linearity, that is K |Ain|^ ^ 1, condition which 
avoids the build-up of transverse instabilities. The cal- 
culation will be performed up to second order in the in- 
put intensity. Only in zero order the fundamental mode 
propagates undisturbed. Solving propagation equation 
( p^ ) in iterative steps up to second order leads to the fol- 
lowing expression for the fundamental mode amplitude 
after propagation through the medium 
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In first order, the effect of the Kerr medium is a non- 
linear phase shift </?nl proportional to the light intensity, 
like in the single mode approximation. After isolating the 
second order contribution of the non- linear phase shift, 
one notices also a non-linear loss term 7nl due to the en- 
ergy transfer into higher order modes. It has to be noted 



We recall here that we will use a linear treatment of the 
fiuctuations around the working point of the system. All 
relations for the complex amplitudes are therefore iden- 
tical to the corresponding relations for the annihilation 
and creation operators Op and aj^ of mode p. Fluctuations 
are characterized by their correlation functions Ca(3 (t): 



C„/3 (r) = {a{t + T)l3 (t)) 
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The brackets correspond to the quantum mechanical ex- 
pectation value. To calculate the explicit expressions for 
correlation functions it is convenient to consider the prob- 
lem in Fourier space. Transformations between frequency 
and time domain are defined in the following way: 
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The Wiener Kinchin theorem establishes a relation be- 
tween time and frequency dependent correlation func- 
tions: 

{a [uj] [3 [uj']) = 2t:5 {uj + uj') C^p [uj] 

= 2ttS {uj + Lj') J drCafi (t) e'"^^. (23) 

Therefore fiuctuations of a given mode may be completely 
described with the help of the following 2x2 matrix y_p 
which contains all four field autocorrelation functions: 



After this brief introduction we will now consider 
the propagation of quantum fiuctuations inside a Kerr 
medium. To this aim we will first derive a propagation 
equation for fiuctuations of mode p using the propagation 
equation for the mean field. Differentiating equation ( p^ ) 
leads to: 
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In the case of a small non-linearity we develop the sta- 
tionary mean field of the fundamental mode up to second 
order and obtain a perturbative solution for the modifi- 
cation daQ of its fluctuations, which may be written as 
the sum of a parametric term rfaolpar additional fluc- 
tuations dttoladd coming from higher order modes: 



dao ^ c?ao|par+ c^"oladd' 

'^'"olpar = *'/'NL (2q;o + "S) 
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^"oladd = 2iV3NL ^ K/aq + iif-Nh ^ Xqa* 
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For simplicity we have assumed the incoming field ampli- 
tude to be real. The parametric term may be readily 
obtained by differentiating equation (|l^) . It corresponds 
to the usual parametric change of quantum fluctuations 
and is obtained similarly in the single mode approxima- 
tion. The additional fluctuations can be understood as a 
consequence of the losses experienced by the fundamen- 
tal mode due to its coupling to higher order modes. They 
correspond mainly to phase conjugated noise. Indeed in 
first order, they may be written as: 
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Their correlation function 
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is characteristic of the mode coupling by the Kerr 
medium and we will find it again in the following. Notice 
that even for small non-linearities this additional noise is 
never negligible. 



IV. FIELD PROPAGATION INSIDE A BISTABLE 
CAVITY 

We come now to the case where the non-linear medium 
is not in free space but placed inside an optical cavity. We 
will consider the input field to be perfectly matched to 
the fundamental Gaussian mode of the cavity [p — I = 
for the input beam). Inside the cavity higher order trans- 
verse modes become important due to non-linear cou- 
pling. However, because of the cylindrical symmetry of 
the problem, we do not have to consider higher order 
modes with non-circular symmetry (Z ^ 0) . The cavity is 
supposed to be single ended, with an input mirror of am- 
plitude transmissivity ^/2rf. In the limit of a high finesse 
cavity it is possible to derive an evolution equation for 
the intracavity field amplitude by evaluating the modifi- 
cation of the field during one roundtrip. The roundtrip 



propagation of the transverse mode n,p gives rise to a 
phase shift ipn^p ~ ^Po + rupi^ + pifT which is the sum of 
the detuning ipo of the fundamental mode and integer 
multiple of the longitudinal phase spacing </jl and the 
transverse phase spacing ip^ between different transverse 
modes. In a first approach, we will suppose the spacing 
between longitudinal modes to be much larger than ipT^. 
In this limit, only one family of modes corresponding a 
longitudinal index uq has to be considered. This assump- 
tion will be given up in the last section, where we will 
consider also the infiuence of different longitudinal cavity 
modes. 

Compared to the case of field propagation through a 
non-linear medium placed in free space, the field evolu- 
tion equation inside the cavity has now to contain ad- 
ditional terms which take into account losses of the in- 
tracavity field as well as transmission of the input field 
through the cavity coupling mirror: 

dApjt) 
dt ^ 
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Tc is the roundtrip time of the field inside the cavity. In 
the last term one recognizes the field modification due 
to the presence of the Kerr medium. For an empty cav- 
ity at resonance, the mean amplitude of the fundamen- 
tal mode is A^ax — \p^^A-^ where the mean ampli- 
tude of the fundamental mode is A™ = (^o")- We can 
then define normalized mode amplitudes Ap = Ap/Amax, 



A'^ = A;;Vyl'" and A'^^ = A™7A"^ respectively for the 



intracavity, input and output fields, 
sionless evolution equation 



They obey a dimen- 
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where r = "jt/Tc is a dimensionless time, (j)p — ipp/"/ is the 
normalized phase shift of mode p and K — K |A,nax|^ H 
the normalized non- linear coupling coefficient. The out- 
put field is given as a sum of the reflected input field and 
the transmitted intracavity field: 



A°^\t)^~A}^{t) + 2Ap{t). 



(32) 



In a single mode approximation, the intracavity inten- 
sity exhibits bistable behaviour because of the intensity 
dependent phase shift. This phenomenon occurs as soon 
as the non-linear phase shift 0nl of the field is of the 
same order than the cavity width 7. Expressed with the 
dimensionless non-linear coupling coefficient K the cor- 
responding condition is if ^ 1. 

The evolution equation for the fluctuations is obtained 
by differentiating equation ( |3T| ) for the mode amplitudes 
around the stationary working point 



drttp = - (1 + i(t>p) ap 
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Ar is the stationary intracavity amphtude of mode p. 
Although we consider an input field which is spatially 
matched to the fundamental cavity mode, we neverthe- 
less have to take into account fluctuations entering the 
cavity through all possible input modes. The output fluc- 
tuations can be deduced from 
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We have denoted here ap, aj," 
of the normalized amplitudes Ap, A" 



and a°"* 
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the fluctuations 
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A. Multimode perturbative approximation 

As mentioned in the beginning of this section we will 
first consider the case where the transverse mode spac- 
ing is large compared to the cavity bandwidth. {(pT 
V't/t 3> 1). Hence, when the fundamental mode is 
nearly resonant, higher order transverse modes are far 
off resonance and their amplitudes will be small com- 
pared to the amplitude of the fundamental mode. This 
situation allows one to adopt a perturbative treatment 
of the coupling between fundamental and higher order 
modes, where the latter enter as first order quantities. 
Equation (|l|) can now be solved in iterative steps up to 
second order in the fundamental mode amplitude which 
leads to the new stationary state: 
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(f)Q is the normalized linear phase shift. The first bracket 
gives the loss in the fundamental mode due to energy 
transfer to higher order modes. The last three terms in 
the second bracket describe the non-linear phase shift of 
the fundamental mode by the presence of higher order 
modes. Energy transfer and phase shift arise as soon 
as higher order transverse modes exist, but they are the 
smaller the more distant the perturbing transverse modes 
are from a cavity resonance. However, they increase with 
increasing intensity in the fundamental mode. At lowest 
order, their expressions are given by 
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By comparin g th is relation to the free space situation 
(cf. equation (|l9|)), one notices that the relations depend 
now on the cavity width 7 as well as on the transverse 
mode spacing 0t- In general the cavity may therefore 
suppress or enhance the non-linear losses depending on 
whether the fundamental mode and higher order modes 
are degenerate or not. For the non degenerate cavity that 
we consider here the cavity reduces the non-linear losses 
considerably. 

We will now discuss the treatment of fluctuations 
where we will calculate the field autocorrelation func- 
tions following the same iterative steps as in the mean 
field calculation. Equation ( p3[ ) couples fiuctuations of 
all transverse modes and their conjugates. In the fre- 
quency domain it takes the following algebraic form 
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where we have introduced the matrices M^^ and r] defined 
by 
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Lj is the fluctuation frequency normalized by the cavity 
bandwidth 7. By manipulating (^) the intracavity fluc- 
tuations Ix p of mode p may be expressed as a function 

^in 

of its incoming fluctuations a „ and of intracavity fluc- 



tuations a q in other modes: 
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Gp is the propagator of an arbitrary mode p 7^ defined 
by 



Gp = {l-iu: + iri (00 + P0T - Mpp) )"' ■ 



(45) 



With the use of standard projector techniques, it is pos- 
sible to express fluctuations in the fundamental mode in 
an analogous way: 



a = Gq 



(46) 



Here we have taken explicitly into account the coupling of 
fiuctuations in the fundamental mode with input fluctu- 
ations in higher order modes by introducing the transfer 
function T^. Gq is the propagator of the fundamental 
mode, which may be written as 



Gq = (1 - «w + iTi<Po + EoY 



(47) 
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is a matrix corresponding to non-linear phase shifts 
and losses. Equation ( ^ ) clearly shows that the intra- 
cavity fluctuations of the fundamental mode are of the 
same order of magnitude than its incoming fluctuations. 
In the case of large transverse mode spacing $t one can 
now analyze perturbatively the intracavity fluctuations 
of higher order modes. We present the detailed calcu- 
lation in the appendix (B) where we give in particular 
the results for non-linear phase shifts and losses as well 
as for the transfer function. Here we will concentrate 
on the calculation and discussion of the physically more 
interesting quantity, the fluctuations in the output beam. 

We might first rewrite the intracavity fluctuations in 
a more compact form as the sum of two contributions, 
one coming from the input fluctuations the other from 
non-linear coupling: 



= Gq ^7?q + 7? add) , 
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The fluctuations in the output beam may now be calcu- 
lated with the help of expression (B4h: 
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Their correlation function is found to split into the same 
distinct parts, the input noise which is transformed by 
the cavity and the added noise due to non-linear coupling: 



,0 - (-1 + 2Go) Kin (-1 + 2Go) V 4GoZaddGo. 
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The propagator Gq of fluctuations in the fundamental 
mode is uniquely determined by the matrix Rq given in 
the appendix (B). It is important to notice that all losses 
and phase shifts due to coupling to higher order modes 
vanish at least with I/^t- Rq reduces therefore to a 
term corresponding to a simple Kerr phase shift as soon 
as (/)T becomes large. The incoming beam is supposed 
to be in a coherent state so that its input fluctuations 
correspond to vacuum noise. In this case the sum over 
all transverse modes in (|4|) may be performed and we 
find the correlation function of the added noise to be 
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This result may be compared to the case of a fun- 
damental Gaussian mode propagating through a Kerr 
medium without a surrounding cavity (cf. equation (p9[)). 
Clearly, the additional noise is more and more suppressed 
with an increasing spacing between transverse modes. 
Under these conditions it is possible to describe the sys- 
tem in a single mode approximation. 



B. The two mode approximation 

In the previous sections, we have considered only one 
longitudinal mode and assumed the corresponding funda- 
mental mode and transverse modes to be non degenerate. 
However, complications might arise when a transverse 
mode corresponding to a different longitudinal mode co- 
incides with the fundamental mode of the cavity. In that 
case we expect important changes in the mean intracav- 
ity intensity as well as in the quantum fluctuations of the 
fundamental mode. We therefore consider now a situa- 
tion where not only the transverse modes (index p) of 
the cavity are important, but also its longitudinal modes 
(index n) 



(52) 



ip\j is the free spectral range of the cavity. As before we 
will assume in this section the fundamental mode and 
higher order transverse modes of the same longitudinal 
mode family to be non degenerate, i.e. (/?t ^ 7- How- 
ever there is still the possibility of degeneracy between 
two modes a and h when ria^jL + VaH^T — nbifh + PbfT- 
In such a situation, the degeneracy concerns the whole 
family of modes. Since the coupling coefficients between 
the fundamental mode and higher order modes rapidly 
decrease with increasing mode order we will only con- 
sider the first two modes of the family. 

The fundamental TEMoo mode, denoted A with fluc- 
tuations a, will be coupled to an arbitrary transverse 
mode B (with fluctuations /?) of order p. When the in- 
put field is perfectly matched to the fundamental cavity 
mode, the evolution equations for the two modes, derived 
from equation (|3l|), are 

drA = 1 - (1 + A + iK \\Af A 



(53) 
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+Xpp (SM* + 2 \B\^ Aj + Xpppo \B\^ B 
drB ^0-{l + i(t)b) B + iK \Xp {Al^ A 
+Xpp(a^B* + 2\AfB') 
+Xpppo (^B^A* + 2\B\''a] +X 
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The coefficient Xp = 1/2^ is at the origin of the energy 
transfer from mode a to mode b. Its value decreases 
rapidly with increasing mode order p. This effect may 
be seen in figure 1 where we have plotted the intracav- 
ity intensity of the fundamental mode as a function of 
cavity detuning. Different bistability curves correspond 
to different transverse mode orders p. The relative linear 
detuning between the fundamental mode and the trans- 
verse mode is here chosen to be zero. As soon as the mode 
order is larger than 4, the modification of the intracavity 
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intensity of the fundamental mode due to non-linear cou- 
pling with the transverse mode becomes negligible com- 
pared to the single mode approximation (dashed line). 
The influence of the non-linear coupling between the two 
modes is expected to vary with their relative detuning. 
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FIG. 1. Bistability curves showing the intracavity inten- 
sity I = \A\q in the fundamental mode as a function of cavity 
detuning (j> in the two mode approximation. The non-linear 
coefficient is K = 2.5, the relative detuning Sep = (pi, — (pa ~ 0. 
Differents curves in solid line correspond to increasing trans- 
verse mode order p: (a) p = 1, (b) p — 2, (c) p — 3, (d) p = 4, 
(e) p = 5. The dashed line corresponds to the single mode 
approximation. 

The modification of the bistability curve of the fun- 
damental mode for various detunings between the two 
modes can be seen in figure 2, where the fundamental 
mode is coupled to the transverse mode p — 4. Its pertur- 
bation is maximal when the transverse mode is resonant 
with the fundamental mode. Since the two modes expe- 
rience both linear and non- linear phase shifts, resonance 
occurs for a non-zero linear detuning dcp = — 0a, where 
(j)a and (j)b denote respectively the linear phaseshifts of 
mode a and b. 
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FIG. 2. Intracavity intensity X — \A\q in the fundamental 
mode as a function of cavity detuning (f) in the two mode 
approximation for a transverse mode p = 4. The non-linear 
coefficient is K — 2.5. Difi'erent curves correspond to different 
detunings 5(j) between the two modes. The dashed line marks 
the maxima of the bistability curves. 



We will now analyze the influence of the non-linear 
coupling on fluctuations of the fundamental mode. It is 
first worth noting that the behaviour of coefficient App 
for a large transverse mode order is 



1 (2p)! 
4^ iplf 



(55) 



This expression looks similar to a cross Kerr effect be- 
tween the two modes. The value of this coefficient is 
decreasing only slowly with increasing mode order. The 
consequences will be discussed in the following para- 
graph. 

The equation for the evolution of fluctuations in the 
two modes is obtained by linearizing the mean fleld equa- 
tions (^,^). It is convenient to represent these fluctua- 
tions in a four element vector ~a 



a 
a* 

(3* 



which satisfies the evolution equation: 

, .in , 

d^a^a - {l + i^ + iKM_)a . 



(56) 



(57) 



$ is a diagonal four by four matrix containing the linear 
detunings (j)a and for the two modes. In the matrix 
M we have collected all non-linear terms. The exact 
expressions of both $ and M can be found in appendix 
(C). The input-output relations for field fiuctuations in 
terms of correlation matrices V^ut and VJn lead to the 
following relation between the correlation functions 



V° 



l~M- 



l + M ■ 



l-M 



M 



(58) 



Again the input field is supposed to be in the vacuum 
state. With the help of the exact expression for M_ (cf. 
equation (|C3|)) it is then possible to calculate the cor- 
relation functions of the output field. We will discuss 
the result by showing the corresponding numerical noise 
spectra. 

Figure 3 shows the optimum noise reduction in the 
fundamental mode as a function of the dimensionless fre- 
quency LJ. We have supposed fluctuations to be mea- 
sured in a homodyne detection ||2^,|2l|,^ where the out- 
put beam is superimposed with a local oscillator whose 
spatial structure corresponds to the TEMqo mode. The 
shot noise level is normalized to 0, perfect squeezing cor- 
responds to —1. For all curves, the working point has 
been chosen on the upper branch of the bistability curve 
near the bistability turning point. Different curves cor- 
respond to transverse mode orders. Clearly, the effect of 
different non-linear coupling compared to the single mode 
approximation (dashed line) is a reduction and even sup- 
pression of the squeezing in the fundamental mode due 
to added 



7 




FIG. 3. Optimum squeezing in the fundamental mode ver- 
sus normalized frequency uj for a coupling to various higher 
order modes. The local oscillator is supposed to be matched 
to the TEMoo mode. The working point is on the upper 
branch of the bistability curve close to the turning point. The 
non-linear coefficient is Js' = 2.5, the relative detuning 5<j) = 1. 
Different curves in solid line correspond to increasing trans- 
verse mode order p as mentioned in the figure. The dashed 
line corresponds to the single mode approximation. 

noise coming from the perturbing mode, even though the 
spatial structure of the fundamental mode is perfectly 
matched to a cavity mode. It has to be noticed that 
this perturbation is higher than what would have been 
expected from the examination of the bistability curves: 
for the mode p = 5, the steady state (figure 1(e)) is al- 
most the steady state of the single mode cavity and only 
a small fraction of the incoming photons is transferred 
to the second mode. However, the added noise is suffi- 
cient to degrade significantly the squeezing around zero 
frequency. This large modification is due to the non neg- 
ligible value of the " cross Kerr" coupling App between the 
two modes, which is still important for p = 5. 

The influence of the relative detuning between the two 
modes is shown in figure 4 where the squeezing spectra 
of the fundamental mode are plotted for a coupling with 
the transverse mode p — A and various relative dctun- 
ings. A comparison with figure 2 shows that fluctuations 
are much more sensitive to the detuning between the two 
modes than the mean field. In particular, quadrature 
squeezing in the fundamental mode is found to be com- 
pletely suppressed in some range of cavity detuning. This 
shows that even in a perfectly matched cavity the non- 
linear transverse mode coupling can limit the value of 
quadrature squeezing attainable. 

However, it is possible to recover an optimal quantum 
noise reduction in the output beam, if the spatial struc- 
ture of the local oscillator is chosen more carefully. To 
illustrate this effect we have plotted in figure 5 the op- 
timum squeezing in a field quadrature corresponding to 
a linear superposition between the fundamental and the 
pertubing mode. Fundamental and higher order mode 
are supposed to be resonant so that the perturbation due 
to the mode coupling is maximal. Even for a coupling 
with a mode of an order as low as p = 3 the squeezing at 




FIG. 4. Optimum squeezing in the fundamental mode ver- 
sus normalized frequency ua for various relative detunings 5(j). 
The working point is on the upper branch of the bistability 
curve close to the turning point. The non-linear coefficient 
is _R" = 2.5. Different curves in solid line correspond to: (a) 
54) = 2, (b) 5(j) = 1, (c) 5(j) = 0, (d) = -1, (e) Sif) = -2. 

zero frequency is here almost perfect. This result has 
to be seen in comparison with figure 3 where we had 
shown the optimum squeezing in the output beam for 
the same experimental parameters but measured with a 
local oscillator the spatial structure of which was not op- 
timized. It can also be noticed that here the noise reduc- 
tions obtained for a coupling with different transverse 
modes show little differences. This can be understood 
from the squeezing mechanism. The bistability turning 
point is a critical point at which fluctuations in one of 
the field quadratures diverge. Since the system is loss- 
less, fiuctuations in the conjugated field quadrature have 
to tend to zero when the turning point is reached. 

Compared to quadrature squeezing the infiuence of 
non-linear coupling on intensity squeezing is very differ- 




FIG. 5. Optimum squeezing versus normalized frequency 
Lj for a coupling to various higher order modes. The local 
oscillator is supposed to have an optimzed spatial structure. 
The working point is on the upper branch of the bistability 
curve close to the turning point. The non-linear coefficient 
is K — 2.5, the relative detuning Sep = 1. Different curves 
in solid line correspond to increasing transverse mode order 
p as mentioned in the figure. The single mode approximation 
coincides with the curve of mode 7. 
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ent. Figure 6 shows a comparison of the attainable inten- 
sity squeezing for a couphng to various modes. Clearly, 
this squeezing is very robust against the mode coupling. 
Furthermore the curves for various modes show little dif- 
ferences. 




FIG. 6. Intensity squeezing versus normalized frequency uj 
for a coupling to various higher order modes. The working 
point is on the upper branch of the bistability curve close 
to the turning point. The non-linear coefficient is K = 2.5, 
the relative detuning S(j> = 1. Different curves in solid line 
correspond to increasing transverse mode order p. The single 
mode approximation coincides with the curve p = 7. 

As expected from the squeezing by a lossless medium the 
noise at zero frequency is not modified since the total 
photon number is conserved. It also has to be noticed 
that for a coupling with mode p — 3, the energy transfer 
from the fundamental mode to the transverse mode is 
not negligible. As a consequence the spatial structure 
of the beam going out of the cavity is quite different 
from the fundamental mode. Its intensity fluctuations 
are nevertheless reduced and this reduction corresponds 
to the one that could be expected from the single mode 
situation. 



V. CONCLUSION 

In this paper, we have studied the non-linear coupling 
between transverse modes in a Kerr medium and its effect 
on bistability and quantum noise if the medium is placed 
inside a cavity. Whereas in free space the non-linear cou- 
pling becomes important as soon as the non-linear phase 
shift is appreciable, the use of an optical cavity can re- 
duce significantly the perturbing effect of the transverse 
modes by selecting only a few modes. When fundamen- 
tal and higher order modes belong to the same longi- 
tudinal mode family and only the fundamental mode is 
resonant, it is possible to treat higher order transverse 
modes perturbatively. The non-linear coupling leads to 
losses for the fundamental mode associated with an ex- 
cess noise which contains a contribution from phase con- 
jugated noise. The non-linear loss scales with the inverse 
of transverse mode spacing. Perturbations due to higher 



order transverse modes can therefore be neglected as soon 
as the transverse mode spacing becomes large compared 
to the cavity width. In this case a single mode approxi- 
mation is valid. 

In an experiment the fundamental mode may acciden- 
tally coincide with a transverse mode corresponding to 
a different longitudinal mode family. In this case, one 
can perform the calculations in a two mode approxima- 
tion. We have shown that even if the spatial structure of 
the input beam is perfectly adapted to the fundamental 
mode of the cavity, the non-linear coupling produces an 
excess noise in the fluctuations of the fundamental mode 
and therefore can limit the optimum squeezing. The per- 
turbation always arises when low order modes {p < 6) co- 
incide resonantly with the fundamental mode during the 
resonance scan of the cavity. The reduction or even sup- 
pression of the obtainable squeezing occurs then in the 
central part of the noise spectrum. Quadrature squeezing 
in the fundamental mode is thus sensitive on perturba- 
tions by higher order modes. However, it is possible to 
recover the optimum squeezing in the output beam if the 
spatial structure of the local oscillator is optimized. Fluc- 
tuations are then not measured in the fundamental mode 
but in a mode corresponding to a linear superposition of 
the fundamental and the perturbing mode. 

In contrast to quadrature squeezing quantum noise re- 
duction in the total output intensity of the fundamental 
mode turns out to be very robust to perturbations by 
higher order modes. Hence, a Kerr medium inside an op- 
tical cavity remains a good intensity "noise eater" even 
when taking into account higher order transverse modes. 

Acknovifledgments: Thanks are due to S. Reynaud, 
C. Fabre, C. Schwob and L. Hihco for discussions. 



APPENDIX A: NONLINEAR COUPLING 
COEFFICIENTS 

The calculation of expression for the non-linear cou- 
pling coefficients Xp^7°^ between Gauss-Laguerre modes 
in a Kerr medium can be performed by making use of 
the generating functions of the Laguerre Polynomials 



Gi'^ {x,z): 



1 



(l-z) 



exp 



xz 



1 



(AI) 
(A2) 



The coupling coefficient may then be reexpressed as a 
function of the generating functions 



9 pip+q+r+s 
Ulmno) ^ ^ 

plqlrlsl dz{dzldzldzl 



■x.Gf> (x, Z2) G['^ {x, Z3) G^p ( 
xexph2x] L^=,,^,3=,^^o • 



(A3) 
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In cylindrical symmetry and with r = s = they simplify 
to 



2 QP+g r°° 1 



plqldzfdzlJo (l-zi)(l-^2)' 

21 , Z2 



(A4) 



X exp X 



- 2 



2 1 1 (p + g)! 



pig! dzfdzf 2 — zi — Z2 



lzi=Z2=0 



2P+9 p!g! 



APPENDIX B: THE MULTIMODE 
APPROXIMATION 

The evolution equation of mode p may be rewritten as 

^ ^in ^ ^ ^ J, 

" p = a p + iGpVMpn a + iGpT/ 2^ Mp^ a 



(Bl) 



By iterating once and inserting the result in the evolution 
equation of the fundamental mode (Bl) gives 



1 , .in X — ^ 

Go = ^0 - 22nMo,G^n.M. 



■qO 



a 



^in 

MogGg a g 



q^O 

UM-OqGqVKqrGr^T ■ (B2) 

This equation may be resolved for uq, and fluctuations 
in the fundamental mode may now be rewritten in the 
more convenient form 



^Af -2 I A 
3|A|' 



,2 

-2^5^ -3 1 A 



-12i^; 



/-I V-3^5' -4 I A I' 



(B7) 



The specific expression for the transfer matrix evaluates 
to 



T = - 



2^ " ^^r^^qr 



2|A| 



(B8) 



APPENDIX C: THE TWO MODE 
APPROXIMATION 

The evolution equation for the complex amplitude of 
the two modes is 

dr~a = - (1 + i$ + iKM) ~a, (CI) 
with the four dimensional matrices [0] and [M] : 



$ = 



$a 
$b 



0a 
-(/-a 



(/-b 




(C2) 



a 



(B3) 



9#0 



(C3) 



with the propagator [Gq] for the fundamental mode and 
the transfer matrix T„ 



Ma = 



'2\A\' -A^ 
A*^ 2 1^1' 



Q*2 2\B\- 



Go = (1 - + i?o + iyy^o) ^ , (B4) 
= Mo,G, + * E Mo,G,Z7M,,G„ (B5) 

r^q,n 

Ro = -iuMoa + J2n.^OqGqriM^o 



q^O 



+ tJ2Yl briMogG^riMqrGrriM. 

q^O r^qfi 



rO- 



(B6) 



In the multimode perturbative expansion the expression 
of Rq can be simplified to 



Mab = 



-2{A*B + AB*) -2AB 

2AB 2{A*B^AB*) 



Ma 



Mb Mab 
Mab Ma 



Mb 



Ml = 



Mab Ma 
Ma 

Mb 

Mb Mab 



(C4) 



(C5) 
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